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(54) DEVICE AND METHOD FOR PROCESSING IMAGE 

(57)Abstract: 

PROBLEM TO BE SOLVED: To three-dimensionally 
display an object from comparatively a little subjects and 
to display a three-dimensional(3D) image reducing the 
distortion of the image even without the 3D shape model 
of high accuracy. 

SOLUTION: In steps S1-S4, the 3D surface data of the 
object are generated for each pair of adjacent subjects 
among plural subjects provided from different viewpoints. 
In steps S5-S1 6, the 3D surface data to be used are 
selected based on an observation position designated by 
user operation and the viewpoints of the said plural 
subjects and while using the selected 3D surface data, 
the 3D image corresponding to the viewpoint of that 
observation position is generated and displayed. 
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* NOTICES * 

JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2. **** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1]An image processing device comprising: 

The 1st creating means that generates a three-dimensional geometric model of a photographic 
subject for every pair of an object image which two or more object images obtained from a 
different viewpoint adjoin. 

A selecting means which chooses a three-dimensional geometric model which should be used 
based on a viewpoint of an observation position and two or more of said object images. 
The 2nd creating means that generates a three-dimensional picture corresponding to a viewpoint 
of said observation position using a three-dimensional geometric model selected by said 
selecting means. 

[Claim 2]The image processing device according to claim 1 having further a display control 
means for displaying a three-dimensional picture generated by said 2nd creating means. 
[Claim 3]The image processing device according to claim 1, wherein said 2nd creating means 
generates a three-dimensional picture corresponding to said observation position by central 
projection using a three-dimensional geometric model selected by said selecting means. 
[Claim 4]The image processing device according to claim 1 having further a texture-mapping 
means to stick on this three-dimensional geometric model an image pattern of an object image 
used for generating a three-dimensional geometric model selected by said selecting means. 
[Claim 5]The image processing device according to claim 4 determining whether to adopt which 
image pattern of the pairs of an object image used for said texture-mapping means generating 
said selected three-dimensional geometric model based on a view position for said display. 
[Claim 6]The image processing device according to claim 4 sticking on this three-dimensional 
geometric model an image pattern produced by superimposing an image pattern of two object 
images used for said texture-mapping means generating a three-dimensional geometric model 
selected by said selecting means. 

[Claim 7]The image processing device according to claim 1, wherein said 1st creating means 
computes a three-dimensional position of each part of a photographic subject using a principle of 
triangulation and generates a three-dimensional model based on a pair of said object image, and 
a position of each viewpoint. 

[Claim 8]In a pair of an object image, two or more movement vectors showing movement of 
subregion are extracted, Have further the 3rd creating means that generates a parameter with 
which movement of a viewpoint between the object images concerned and a direction are 
expressed based on a movement vector of this plurality, and said 2nd creating means, The image 
processing device according to claim 1 characterized by generating a three-dimensional picture 
corresponding to a viewpoint of said observation position based on a parameter generated by 
said 3rd creating means, and a three-dimensional geometric model selected by said selecting 
means. 

[Claim 9]An image processing method comprising: 

The 1st generation process of generating a three-dimensional geometric model of a photographic 
subject for every pair of an object image which two or more object images obtained from a 
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different viewpoint adjoin. 

A selection process which chooses a three-dimensional geometric model which should be used 
based on a viewpoint of an observation position and two or more of said object images. 
The 2nd generation process of generating a three-dimensional picture corresponding to a 
viewpoint of said observation position using a three-dimensional geometric model selected by 
said selection process. 

[Claim 10]The image processing method according to claim 9 having further a display control 
process for displaying a three-dimensional picture generated at said 2nd generation process. 
[Claim 1 1]The image processing method according to claim 9, wherein said 2nd generation 
process generates a three-dimensional picture corresponding to said observation position by 
central projection using a three-dimensional geometric model selected by said selection process. 

[Claim 12]The image processing method according to claim 9 having further a texture-mapping 
process of sticking on this three-dimensional geometric model an image pattern of an object 
image used for generating a three-dimensional geometric model selected by said selection 
process. 

[Claim 13]The image processing method according to claim 12 determining whether to adopt 
which image pattern of the pairs of an object image used for said texture-mapping process 
generating said selected three-dimensional geometric model based on a view position for said 
display. 

[Claim 14]The image processing method according to claim 12 sticking on this three-dimensional 
geometric model an image pattern produced by superimposing an image pattern of two object 
images used for said texture-mapping process generating a three-dimensional geometric model 
selected by said selection process. 

[Claim 15]The image processing method according to claim 9, wherein said 1st generation 
process computes a three-dimensional position of each part of a photographic subject using a 
principle of triangulation and generates a three-dimensional model based on a pair of said object 
image, and a position of each viewpoint. 

[Claim 16]In a pair of an object image, two or more movement vectors showing movement of 
subregion are extracted, Have further the 3rd generation process of generating a parameter with 
which movement of a viewpoint between the object images concerned and a direction are 
expressed based on a movement vector of this plurality, and said 2nd generation process, The 
image processing method according to claim 9 characterized by generating a three-dimensional 
picture corresponding to a viewpoint of said observation position based on a parameter 
generated at said 3rd generation process, and a three-dimensional geometric model selected by 
said selection process. 

[Claim 1 7] A storage which stores a control program which makes a computer generate three- 
dimensional geometric model data, comprising: 

A code of the 1 st generation processing in which this control program generates a three- 
dimensional geometric model of a photographic subject for every pair of an object image which 
two or more object images obtained from a different viewpoint adjoin. 

A code of a selection process which chooses a three-dimensional geometric model which should 
be used based on a viewpoint of an observation position and two or more of said object images. 
A code of the 2nd generation processing that generates a three-dimensional picture 
corresponding to a viewpoint of said observation position using a three-dimensional geometric 
model selected by said selection process. 



[Translation done.] 
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* NOTICES * 

JPO and INPIT are not responsible for any 
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DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention]This invention relates to the image processing method and device for 
generating the three-dimensional picture of a photographic subject based-on the picture which 
photoed the photographic subject from two or more directions with the camera. 
[0002] 

[Description of the Prior Art]Conventionally, two or more object images obtained with the 
camera by photoing a photographic subject from two or more hands of cut are stored, and the 
system on which the picture from a desired hand of cut is displayed is known, This kind of 
system associates and records bearing of the exposure axis on each of two or more obtained 
object images, and displays the object image of the bearing of the exposure axis corresponding 
to the hand of cut of the directed object image at the time of reproduction. With such a function, 
an operator becomes possible [ operating an object image interactively ]. 

[0003]One example of the photographing method of an object image is shown in drawin g 3. In this 
example, the photographic subject 1 is fixed on the turntable 2, it fixes to the tripod 4 and the 
camera 3 is photoed. Generally a plain thing is used for a background. It sets up so that the 
center of the photographic subject 1 may come on the axis of rotation of the turntable 2 mostly 
at this time, and it sets up so that the optic axis of the camera 3 may intersect the axis of 
rotation of the turntable 2. It is made for the whole photographic subject 1 to enter in the frame 
to photo. And the picture from [ of a photographic subject ] plurality is photoed, rotating the 
turntable 2 with equiangularity mostly. 

[0004]And arrange so that two or more object images photoed as mentioned above, for example 
may be outputted along bearing of the exposure axis, and at the time of reproduction. If an 
object image is chosen one by one according to the hand of cut of the directed object image and 
it is made to display, a picture which the photographic subject is rotating in three dimensions is 
observable. 

[0005]The three-dimensional model of a photographic subject is generated from two or more 
object images, the image pattern of a photographic subject is stuck on a three-dimensional 
model, and arbitrary camera positions and the system which displays the picture of the 
photographic subject in a direction in three dimensions are known. 
[0006] 

[Problem(s) to be Solved by the Invention] However, two or more object images were prepared, 
and in order to display as the photographic subject is rotating in three dimensions comfortable in 
changing and displaying according to a user s directions, angle of rotation of the photographic 
subject had to be made small, and had to be photoed. For this reason, while photography of many 
object images is needed and photography takes time and effort, a mass image memory will be 
needed. 

[0007]The three-dimensional model of a photographic subject is generated, and to stick and 
display an image pattern, it is necessary to generate the three-dimensional model of a 
photographic subject with sufficient accuracy. It is because distortion of the object image 
displayed that the accuracy of a three-dimensional model is bad will be conspicuous. However, a 
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lot of computation time is needed for generation of such a highly precise three-dimensional 
model. 

[0008]This invention is made in light of the above-mentioned problems, and the purpose, While 
making it possible to display a photographic subject in three dimensions from comparatively few 
object images, it is in providing the image processing method and device which can display the 
three-dimensional picture of a photographic subject with little image distortion easily without 
generating the three-dimensional geometric model of a highly precise photographic subject. 
[0009] 

[Means for Solving the ProblemjAn image processing device by one mode of this invention for 
attaining the above-mentioned purpose is provided with the following composition, for example. 
Namely, the 1st creating means that generates a three-dimensional geometric model of a 
photographic subject for every pair of an object image which two or more object images obtained 
from a different viewpoint adjoin, It has an observation position, a selecting means which chooses 
a three-dimensional geometric model which should be used based on a viewpoint of two or more 
of said object images, and the 2nd creating means that generates a three-dimensional picture 
corresponding to a viewpoint of said observation position using a three-dimensional geometric 
model selected by said selecting means. 

[0010]An image processing method by other modes of this invention for attaining the above- 
mentioned purpose is provided with the following processes. Namely, the 1st generation process 
of generating a three-dimensional geometric model of a photographic subject for every pair of an 
object image which two or more object images obtained from a different viewpoint adjoin, It has 
an observation position, a selection process which chooses a three-dimensional geometric model 
which should be used based on a viewpoint of two or more of said object images, and the 2nd 
generation process of generating a three-dimensional picture corresponding to a viewpoint of 
said observation position using a three-dimensional geometric model selected by said selection 
process. 
[0011] 

[Embodiment of the Invention] Hereafter, the suitable embodiment of this invention is described 
with reference to an attached drawing. 

[0012](A 1st embodiment) Drawing 1 is a block diagram showing the outline composition of the 
image processing device by this embodiment. In drawin g 1 , 101 is CPU and realizes various 
processing based on the control program stored in ROM102 or RAM103. 102 is ROM and stores 
the control program and various data which are performed by CPU101. 103 is RAM and provides 
the fieid which stores the control program executed by CPU101 loaded from external storages, 
such as a hard disk, and workspace with CPU101 for [ workspace ] performing various 
processing. 

[001 3] 104 is a keyboard, 105 is a pointing device, and the various inputs to this image processing 
device are performed, respectively. 1 06 is a display and performs a display of a three- 
dimensional geometric model etc. which are mentioned later. 

[001 4] 107 is an external storage, stores the object image data photoed with the camera 3, or 
stores the control program loaded to RAM 103 for execution by CPU 101. 108 is a camera 
interface, and since object image data is stored in the external storage 107, it is mainly used for 
inputting the object image data obtained by taking a photograph with the camera 3. 109 is a bus 
and connects each above-mentioned composition mutually. 

[0015]In following embodiments, although the object image data photoed with the camera 3 is 
inputted and used via the interface 8, it does not restrict to this. For example, two or more 
photographs which photoed the object image may be read with a scanner, and may be inputted 
as object image data, and the picture stored in CD-ROM etc. may be inputted as object image 
data. 

[0016] Drawing 2 is a flow chart explaining the three-dimensional image display procedure by a 
1st embodiment. The control program for realizing the control procedure shown in drawing 2 shall 
be stored in the external storage 107, and shall be loaded to RAM 103 at the time of execution by 
CPU101. Hereafter, this embodiment is described with reference to the flow chart of drawing 2. 
[0017]First, in Step St, with the camera 3, a photographic subject is photoed and image data is 
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acquired. Here, a photograph shall be taken by the method shown in drawing 3. In this 
embodiment, the case where photography is performed to the surroundings of a photographic 
subject 3 times as shown in drawing 4 is explained. Although drawing 3 shows signs that the 
camera was moved for explanation, to rotating the photographic subject at drawin g 4, probably, it 
will be clear that the object image obtained by both drawin g 3 and drawin g 4 is equivalent. In 
drawing 4, p1, p2, and p3 express the camera view position at the time of photography, and the 
arrow shows the optical axis direction. Two or more object images produced by taking a 
photograph in each of p1 f p2, and p3 are memorized to the external storage 107, and perform 
processing following below. In the following explanation, the image data photoed by the camera 
view position p1, p2, and p3 is set to gl, g2, and g3, respectively. 

[0018]After finishing photography of a photographic subject with a camera, it progresses to Step 
S2. In Step S2, a parallax map is extracted from between the adjacent pictures. In this example, 
a parallax map will be extracted about the picture g1, the picture g2, and the picture g2 and the 
picture g3. 

[0019]Hereafter, how to extract a parallax map from two pictures is explained. First, one picture 
is divided into the block of NxM. And for every block, the field in which the image pattern is most 
similar is searched in the picture of another side, and let the searched field be corresponding 
areas. And displacement between both the object images of the center position (representative 
point of a field) of each corresponding field is made into a parallax vector, and the parallax vector 
about all the blocks is extracted, and let this be a parallax map. Extracting processing of this 
parallax map is performed among all the adjacent pictures (this embodiment between the 
pictures g1 and g2, g2, and g3). 

[0020]Next, in Step S3, the movement parameters of the camera between two object images are 
computed from the parallax map obtained at Step S2. The movement parameters of a camera 
consist of the parameter Tn showing the move direction of the view position of a camera, and 
the parameter R showing rotation of the optical axis direction of a camera. 
[0021]The calculating method of the movement parameters of the camera explained below, It is 
indicated to Section 15.5 of Addison-Wesley"Computer and Robot Vision Volume II" (R. 
M.Haralick and L.G.Shapiro work). First, the procession F showing the correspondence relation 
between pictures is searched for. The position (u\ v') of the representative point of the field 
corresponding to it of the position (u, v) of the representative point of each block of one picture 
and the picture of another side is taken out from a parallax map, and the procession F with which 
it is satisfied of the following formulas 1 is searched for with a least square method. 
[0022]x'~T F x = 0 (formula 1) 

However, x=(u, v, 1)~T, x'=(u\ v', 1)~T, and F show the rank 2 and the procession of 3x3, and T 
shows a transposed matrix. 

[0023] And the three-dimensional rotation procession R of a camera and unit movement vector 
Tn=T/|T| are calculated from the procession F (however, T movement vector). Calculation 
processing of the movement parameters of this camera is performed among all the adjacent 
pictures (this embodiment between the pictures g1 and g2, g2, and g3). The movement 
parameters of the pictures g1 and g2 acquired by making it above are set to Tn1 and R1, and the 
movement parameters of the pictures g2 and g3 are set to Tn2 and R2. 

[0024]Next, in step S4, three-dimensional surface data (three-dimensional geometric model) is 
generated from the movement parameters of a parallax map and a camera. Three-dimensional 
surface data comprises data in which the arrangement of the vertex data in which the three- 
dimensional position of two or more vertices for expressing a photographic subject with two or 
more triangles is shown, and the triangle data constituted with three vertex data is shown. Two 
two-dimensional coordinates which show the position on two object images of origin of the peak 
other than the three-dimensional coordinates which show the position of a point are assigned to 
each vertex data. In texture mapping at the time of displaying a three-dimensional picture later, 
this is for acquiring the texture in the source image data which should be used. The three- 
dimensional coordinates (X, Y, Z) of the vertex of three square shapes each which constitute 
three-dimensional surface data are calculated by the method using the principle of triangulation 
shown in drawing 5 f rom the position of the corresponding points of the pictures g1 and g2, and 
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movement parameters. 

[0025] However, among the movement parameters of a camera, since T cannot be found as an 
absolute value, it becomes a relative value as which three-dimensional surface data also 
expresses the shape of a photographic subject. Generation processing of this three-dimensional 
surface data is performed among all the adjacent pictures (this embodiment between the 
pictures g1 and g2, g2, and g3). In the following explanation, the three-dimensional surface data 
which generated the three-dimensional surface data generated from the pictures g1 and g2 from 
S1 and the pictures g2 and g3 is set to S2. 

[0026]Next, in Step S5, the photographic subject model which comprises two or more partial 
models from two or more three-dimensional surface data obtained by step S4 is generated. A 
photographic subject model consists of the four partial models M1 1, M12, M22, and M23 in this 
embodiment. The partial model M11 and M12 are generated from the three-dimensional surface 
data S1, and M22 and M23 are generated from the three-dimensional surface data S2. 
[0027] Drawing 6 is a figure showing the characteristic of the partial model generated in a 1st 
embodiment. Here, the partial model M1 1 has the three-dimensional structure based on the 
vertex data of the three-dimensional surface data S1 as three-dimensional surface data, for 
example. And the image pattern of the triangular field where the picture g1 corresponds is stuck 
for every triangle data of the partial model M11. Similarly, the partial model M12, M22, and M23 
have the three-dimensional structure based on the three-dimensional surface data S1, S2, and 
S2, respectively, and the image pattern of the picture g2, g2, and g3 will be stuck. 
[0028]Next, the reproduction condition of a photographic subject model is set up at Step S6. 
Here, the variation of the movement parameters of a camera, a view point movement range, a 
right-and-left contiguity model which are shown in drawin g 6, etc. are set up. 
[0029] First, the viewpoint of a camera moves in the straight-line top which connects with this 
embodiment the view positions p1 and p2 of the camera shown in drawin g 4, and p2 and p3, The 
optical axis direction of a camera sets up the variation of the movement parameters of a camera 
only the quantity proportional to the amount of view point movements rotate within the limits of 
the rotation of the optical axis direction in two viewpoints, and reproduce. If the rotation which 
can obtain dT and the rotation for every reproduction for the variation of the amount of view 
point movements from dQ and the three-dimensional rotation procession R of a camera among 
the variation of the movement parameters of a camera is set to Q, it will set up satisfy the 
following formulas 2. The variation of the movement parameters of the camera at the time of this 
reproduction is set up for every three-dimensional surface data. 
[0030]Tn/dT=Q/dQ (formula 2) 

The view point movement range (r1 1 , r12, r22, r23) in drawing 6 is set to every [ of a 
photographic subject ] partial model (M11, M12, M22, M23). Since this view point movement 
range expresses the range of the view position which can reproduce each partial model and is 
reproduced in the direction of one dimension by this embodiment, the view position of the both 
ends of the reproduction range is set up. About the contiguity model (for example, refer to the 
three-dimensional surface data S1 for both M11 and M12) which refers to the same three- 
dimensional surface data, the view point movement range is set up so that a partial model may 
change in the mid-position during the viewpoint. 

[0031]Since 3-dimensional each surface data (SI, S2) has the independent three-dimensional 
coordinate system defined by the picture of two viewpoints, respectively, the setting-out 
position coordinate of the view point movement range differs in a normal coordinate for every 
three-dimensional surface data. That is, in this embodiment, the group of M1 1, M12, and M22 and 
M23 will have view point movement range data in the respectively same coordinate system. As 
shown in drawin g 6, a left contiguity model and a right contiguity model are set up for every 
partial model. NONE shows that a contiguity model does not exist among drawin g 6. A 
photographic subject model will be reproduced by the above setting out in the view position and 
view point movement range which are shown in drawing 7 . A figure destructive line shows the 
locus of the viewpoint of the camera at the time of reproduction. 

[0032]After finishing setting out of the reproduction condition of a photographic subject model as 
mentioned above next, setting out and its display of a reproduction initial state are performed at 
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Step S7. Here, the window which displays a picture is generated and it displays on the screen of 
the display 106. A window consists of a picture display part and a photographic subject final 
controlling element, and central projection generates the picture (therefore, it is the same as the 
picture g2) which looked at the partial model M22 in the view position of p2 shown in drawin g 7 
by an initial state at this embodiment. Central projection is a way method of the projection in 3D 
computer graphics, and is the well-known technique. In order to generate a picture by central 
projection from the image pattern stuck on three angular domains each of a partial model, 
Addison-Wesley company publication"Computer Graphics:principles and practice and Texture 
Mapping currently described pp.741 of 2 nd edition in C"Foley work - 744 are used. And the 
generated picture is drawn in the memory for a display, and it displays on the display 107 which 
is a picture display part. This situation is shown in drawin g 8. Drawin g 8 is a figure showing the 
displaying condition of the three-dimensional model in this embodiment. In drawin g 8, V is a 
photographic subject final controlling element which a user directs that a picture display part, 
CL, and CR rotate a photographic subject the left and rightward, respectively. The upper right 
button 61 is an end button for the display of the three-dimensional model concerned to be 
ended. 

[0033]Next, operation by a user is acquired in Step S8. And when a user's acquired operation is 
termination indication (for example, click operation of the end button 61), this processing is 
ended from step S9. When judged with the acquired users operation having clicked the 
photographic subject final controlling element CL or CR, it progresses to Step S1 1 from Step 
S10. 

[0034]In Step S1 1, the camera viewpoint by the click of CL or CR is moved, and it is judged as 
the result in which view point movement range a camera viewpoint exists. Namely, a camera view 
position and a direction are first changed in the direction specified by a user from the camera 
view position which is the present reproduction condition, and a direction by the variation of the 
movement parameters of a camera. And as a result, it is judged in which view point movement 
range the camera view position which a reproduction condition expresses is. 
[0035]in Step S12, it judges whether the view position shown by a new reproduction condition is 
view point movement within the limits of a partial model present on display, and if it is within the 
limits, it can kick to Step S15 right [ that ], and will progress to it to Step S13. 
[0036]When a new reproduction condition comes out of the present view point movement range, 
in Step S13, it is judged whether the partial model corresponding to the new view point 
movement range exists with reference to the contiguity model (the left contiguity model of 
drawin g 6, right contiguity model reference) set up about the present view point movement 
range. And if an adjoining partial model exists, it will progress to Step S14 and the change to the 
adjoining partial model will be performed. On the other hand, when an adjoining model does not 
exist, it returns to Step S8, without updating a display. It cannot be overemphasized that it may 
report to a user that a stereo model cannot be displayed in this case. 

[0037]For example, when a user points to rotation of a photographic subject leftward and a user 
points a right contiguity model to rotation of a photographic subject rightward, a left contiguity 
model is investigated, and a change to the model is performed. When the present camera view 
position is p1 (the view point movement range is r1 1) and also the rotation to the right of a 
photographic subject is directed about drawin g 6 (CR was clicked), Since the left contiguity 
model is "NONE", since a contiguity model does not exist, the change of a model is not 
performed, and renewal of a display is not made, either. 

[0038]In Step S15, a reproduction state is updated so that it may correspond in the view 
position of the new camera for which it asked at Step S1 1, and the direction, if the change of a 
partial model arises at this time — a coordinate system — changing . Thus, when a coordinate 
system changes (for example, when a model changes to M12 from M22) End data of the view 
point movement range in which the view position of a camera and the direction are beforehand 
set up for changing to the coordinate system of S2 to S1 (for example, when changing to a left 
contiguity model like M22 to M12) It is updated by the right end data of the view point movement 
range r12 of the coordinate system showing the three-dimensional surface data S1 of M12. 
[0039]Central projection generates the picture acquired when the partial model which should be 
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displayed is seen in the view position of the camera set up, and a direction, and it redraws on the 
memory for a display, and expresses to a picture display part (display 107) as Step S16. And 
processing is returned to acquisition of the user's operation of Step S8. 

[0040]According to a 1 st embodiment, as explained above, the three-dimensional surface data of 
a photographic subject is generated from two adjacent object images, the image pattern obtained 
by this generated three-dimensional surface data from either of these 2 ** object images is 
stuck, and a partial model is generated. And such a partial model is prepared for one pair of 
every object images, and the partial model to adopt is switched based on the specified view 
position. For this reason, even if it is comparatively a few object images, the middle view position 
of an object image and the object image of a direction which were photoed can be displayed in 
three dimensions [ it is comfortable and ]. 

[0041]Since there is comparatively few image data, there is also little capacity of a required 
image memory and it ends. Since the image pattern stuck according to the view position to 
display is also changed while generating the three-dimensional surface data of a photographic 
subject for between [ every ] the adjacent object images, even if it is not three-dimensional 
surface data of a highly precise photographic subject, the three-dimensional picture of a natural 
photographic subject with little image distortion is acquired. 

[0042](A 2nd embodiment) In a 1st embodiment mentioned above, the image pattern stuck on 
the three-dimensional surface data of the photographic subject generated from between the 
adjacent pictures is changed between the image data g1-g3 according to the view position at the 
time of reproduction, as shown in drawing 6 , and an object image is drawn. On the other hand, 
two image patterns of a basis are stuck on one three-dimensional surface data doubly (mixing), 
and it is made to draw in a 2nd embodiment. 

[0043]Since the composition of the image processing device by a 2nd embodiment is the same 
as that of a 1st embodiment, explanation is omitted. Hereafter, operation of a 2nd embodiment is 
carried out to diverting and explaining the flow chart of drawing 2 . 

[0044]The processing to Step S.I which generates the three-dimensional surface data of a 
photographic subject among the processings shown in drawing 2 - S4 is the same as that of a 
1st embodiment mentioned above. Therefore, below, the three-dimensional picture display 
processing after Step S5 is explained. 

[0045]A photographic subject model is generated from two or more three-dimensional surface 
data at Step S5. A photographic subject model consists of the two partial models M1 and M2 in a 
2nd embodiment. The characteristic of each partial model is shown in drawin g 9. Here, the partial 
model M1 has the three-dimensional structure based on the vertex data of the three- 
dimensional surface data S1, for example. And the image pattern of the triangular field in the 
picture g1 to which each peak corresponds, and the image pattern of the triangular field in the 
picture g2 to which each peak corresponds are mixed for every triangle data of three- 
dimensional surface data, and it is stuck. Similarly, as for the partial model M2, the picture g2 and 
the image pattern of g3 are stuck on the three-dimensional surface data S2. 
[0046]Next, the reproduction condition of a photographic subject model is set up in Step S6. 
Here, the variation of the movement parameters of a camera is set up like a 1st embodiment. As 
shown in drawing 9, the view point movement range r1 and r2 are set up to the partial model M1 
of a photographic subject, and each of M2. As the view position of the both ends of the view 
point movement range is shown in drawing 10 , the view position at the time of photography of 
two pictures (pp1, p2, or 3) is set up. As shown in drawing 9 , a left contiguity model and a right 
contiguity model are set up for every partial model. 

[0047]Next, setting out and its display of a reproduction initial state are performed at Step S7. 
According to this embodiment, in a reproduction initial state, central projection generates the 
picture (therefore, it is the same as the picture g2) which looked at the partial model M2 in the 
view position of p2 shown in drawing 10 , and it draws in the memory for a display, and displays on 
a picture display part (display 107). 

[0048]Next, operation by a user is acquired in Step S8. And when a user's acquired operation is 
termination indication (for example, click operation of the end button 61), this processing is 
ended from step S9. When judged with the acquired users operation having clicked the 
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photographic subject final controlling element CL or CR, it progresses to Step S1 1. 
[0049]In Step S1 1, the camera viewpoint by the click of CL or CR is moved, and it is judged as 
the result in which view point movement range a camera viewpoint exists. Namely, a camera view 
position and a direction are first changed in the direction specified by a user from the camera 
view position which is the present reproduction condition, and a direction by the variation of the 
movement parameters of a camera. And as a result, it is judged in which view point movement 
range the camera view position which a reproduction condition expresses is. 
[0050]in Step S12, it judges whether the view position shown by a new reproduction condition is 
view point movement within the limits of a partial model present on display, and if it is within the 
limits, it can kick to Step S15 right [ that ], and will progress to it to Step S13. 
[0051] When a new reproduction condition comes out of the present view point movement range, 
in Step S13, it is judged whether the partial model corresponding to the new view point 
movement range exists with reference to the contiguity model (the left contiguity model of 
drawing 9 , right contiguity model reference) set up about the present view point movement 
range. And if an adjoining partial model exists, it will progress to Step S14 and the change to the 
adjoining partial model will be performed. On the other hand, when an adjoining model does not 
exist, it returns to Step S8, without updating a display. It cannot be overemphasized that it may 
report to a user that a stereo model cannot be displayed in this case. 

[0052] For example, when a user points to rotation of a photographic subject leftward and a user 
points a right contiguity model to rotation of a photographic subject rightward, a left contiguity 
model is investigated, and a change to the model is performed. Since the left contiguity model of 
the partial model M1 is "NONE" when the present camera view position is p1 and also the 
rotation to the right of a photographic subject is directed about drawing 9 (CR was clicked), it is 
judged that a contiguity model does not exist and the change of a model is not performed. 
[0053]In Step S15, a reproduction state is updated so that it may correspond in the view 
position of the new camera for which it asked at Step S1 1, and the direction. When a coordinate 
system changes by the change of a partial model at this time (for example, when a partial model 
changes to -Ml from M2), The view position of a camera, the end data of the view point 
movement range in which the direction is set up beforehand (for example, when changing from 
the partial model M2 to the partial model M1 which is the left contiguity model) It is updated by 
the right end data of the view point movement range r1 of the coordinate system showing the 
three-dimensional surface data S1 of the partial model ML 

[0054]Central projection generates the picture acquired when the partial model which should be 
displayed is seen in the view position of the camera set up, and a direction, and it redraws on the 
memory for a display, and expresses to a picture display part (display 107) as Step S16. And 
processing is returned to acquisition of the user's operation of Step S8. 

[0055]At this time, the mixing ratio of the image pattern stuck doubly is set up according to the 
view position of a camera. For example, in the view point movement range r1 of drawing 10 , In 
the position of p1 which is at the left end of the view point movement range, by the ratio to 
which the mixing ratio of the picture g1 and the picture g2 was in inverse proportion to 0:1 in the 
position of p2 whose mixing ratio of the picture g1 and the picture g2 is at the right end of 1 :0 
and the view point movement range, and in inverse proportion to the distance from the 
viewpoints p1 and p2 in the middle, the image pattern of the pictures g1 and g2. It sticks on the 
partial model M1. 

[0056]As mentioned above, in a 2nd embodiment, while mixing and sticking the image pattern 
from two object images which become one three-dimensional surface data origin and drawing, 
the mixing ratio is changed based on a view position. For this reason, the image pattern of the 
surface of a photographic subject comes to change to nature more. 

[0057]At an above embodiment, although from image data acquisition of a photographic subject 
to three-dimensional image display was constituted from one processing, even Step S1 - S4 may 
consist of two processing parts even for three-dimensional data generation processing of a 
photographic subject and Steps S5-S16 as three-dimensional display processing of a 
photographic subject. In this case, in three-dimensional data generation processing of a 
photographic subject, the movement parameters of the generated three-dimensional surface 

http://ww4.ipdl.inpit.gojp/cgi-bin/tran_web_cgi_ejje?atw_u=http%3A%2F%2Fww... 2009/02/24 



JP,2000-067274,A [DETAILED DESCRIPTION] 



8/9 ^— v 



data and the camera at that time once being memorized to the file from between the pictures 
which two or more object images adjoined as three-dimensional data of a photographic subject, 
and, What is necessary is to read the three-dimensional surface data of the photographic subject 
memorized by the file in three-dimensional data generation processing of the photographic 
subject after Step S5, and just to generate a photographic subject model. 

[0058]In each above-mentioned embodiment, although the three-dimensional surface data of the 
photographic subject was used as vertex data and the three-dimensional data constituted by the 
arrangement of triangle data, it does not restrict to this. For example, it is good also considering 
the parameter of these functions as three-dimensional data of a photographic subject to 
approximate the arrangement of vertex data with the Nth polynomial, a spline surface, a 
secondary super-curved surface, spherical surface harmonics, etc. If it does in this way, when 
once taking the composition which memorizes three-dimensional data to the file, it can have 
three-dimensional data of a photographic subject as a parameter of an approximation model, and 
a three-dimensional model can be memorized with a small storage capacity. If this approximation 
model is reconstructed at the three-dimensional model generate time of the photographic 
subject in step S5 grade in the three-dimensional surface data constituted by the arrangement 
of vertex data and triangle data, the three-dimensional picture of a photographic subject can be 
displayed by the same processing as each embodiment mentioned above henceforth. 
[0059]It explained photoing a photographic subject in front of the plain background in an above 
embodiment as a premise. When a photograph is taken from a direction which is different 
centering on a photographic subject like drawing 4 w hen the background of a photographic 
subject is not solid color, since the picture of a background changes remarkably, it becomes 
difficult to ask for the azimuth difference in a background region correctly. In such a case, what 
is necessary is just to specify the contour part of a photographic subject by a user in advance of 
the parallax map extracting processing in Step S2. At this time, a parallax vector is extracted in 
the photographic subject field specified by a user in parallax map extracting processing. 
[0060]It may be made for change of the border line specified by a user to extract a parallax 
vector to a steep point (when a user specifies the outline of a photographic subject as a polygon, 
it is a vertex of that polygon) at this time. If it does in this way, when generating the three- 
dimensional data of a photographic subject, the three-dimensional structure of the photographic 
subject reflecting a user's specification can be generated. 

[0061]In each above-mentioned embodiment, although the processing at the time of photoing a 
photographic subject from three viewpoints was explained, it is clear that the composition of this 
embodiment is easiiy extensible about the picture of the three or more arbitrary numbers of 
viewpoints. 

[0062]Although the processing at the time of photoing a photographic subject from the viewpoint 
moved in one dimension in an above embodiment was explained, the three-dimensional image 
display method shown by the above-mentioned embodiment also about the picture of the 
arbitrary view positions over which it was distributed in three dimensions is easily applicable. 
[0063]When displaying the three-dimensional picture of a photographic subject in an above 
embodiment, the processing in the case of performing view point movement of a camera in one 
dimension, and reproducing was explained, but it may be made to display the picture which 
looked at the photographic subject from arbitrary three-dimensional view positions and a 
direction. 

[0064]Even if it applies this invention to the system which comprises two or more apparatus (for 
example, a host computer, an interface device, a reader, a printer, etc.), it may be applied to the 
devices (for example, digital camera etc.) which consist of one apparatus. 
[0065]The purpose of this invention the storage which recorded the program code of the 
software which realizes the function of an embodiment mentioned above. It cannot be 
overemphasized that it is attained, also when a system or a device is supplied and the computer 
(or CPU and MPU) of the system or a device reads and executes the program code stored in the 
storage. 

[0066]In this case, the function of an embodiment which the program code itself read from the 
storage mentioned above will be realized, and the storage which memorized that program code 
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will constitute this invention. 

[0067]As a storage for supplying a program code, a floppy disk, a hard disk, an optical disc, a 
magneto-optical disc, CD-ROM, CD-R, magnetic tape, a nonvolatile memory card, ROM, etc. can 
be used, for example. 

[0068]By executing the program code which the computer read, Based on directions of the 
program code the function of an embodiment mentioned above is not only realized, but, It cannot 
be overemphasized that it is contained also when the function of an embodiment which 
performed a part or all of processing that OS (operating system) etc. which are working on a 
computer are actual, and was mentioned above by the processing is realized. 
[0069]After the program code read from the storage was written in the memory with which the 
function expansion unit connected to the expansion board inserted in the computer or the 
computer is equipped, It cannot be overemphasized that it is contained also when the function of 
an embodiment which performed a part or all of processing that CPU etc. with which the 
expansion board and function expansion unit are equipped are actual, based on directions of the 
program code, and was mentioned above by the processing is realized. 
[0070] 

[Effect of the Invention]As explained above, if it gets twisted in this invention, a photographic 
subject can be displayed in three dimensions from comparatively few object images. Even if it is 
not a three-dimensional geometric model of a highly precise photographic subject, the three- 
dimensional picture of a photographic subject with little image distortion can be displayed. 
[0071] 



[Translation done.] 



http://www4.ipdl.inpit.go.jp/cgi-bin/tran_web_cgi_ejje?atw_u=http%3 2009/02/24 



JP,2600-067274,A [DRAWINGS] 



1/3 ^— v 



* NOTICES * 

JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2. **** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 
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wz&&<D=mxm-trcid<Dmmm&<D 3 ^{aa 

^■T20©2^7r:^^fJt)^TC.nTV^o iinti, 

*5l^T> ffl</^^^7Uliftf f -^' : f©f-^X^ + ^# 
-rS^46T'^5o 3 ^^ffi-r- ^ 5 ^ 
©W^©3^7tiS^ (X, Y, Z) tt;, 05It^-TH^ 
W*©Kl*fflv^*jS6KJ: t), iBftg l g 2©WJS 

C0 0 2 5]{BL, *^7©^il/^p<-^£D9-6T(i 



. (5) 
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ft *o C©3#7GSffi-r-*© 

B$g 1 £ g 2 , g 2 £ g 3 OBB) T-fif 5» ft& y «T 
©i&BJT'fct, B&g l £.g 2*»&^j*-tfc34}(7C*ffiT 
-#£S 1 , B&g 2 i: g 3**-6*JSLfe3 3Jj7caiB"r 
r-^SrS 2 i:**. 
[0 0 2 6] ^tC, Xr7yS5Tii, 

tt?ft*7 f ;W4 400«5K'r/l'Ml K Ml 2, M2 10 
2, M2 3<fct)ftS 0 ft*, a^tf/l'M 1 K Ml 2 
tt 3 ^Tt^ffix-^ S 1 £>£j££ft\ M 2 2 % M 2 3 

[ 0 0 2 7 ] B 6 14B 1 O*fl0g«»C*V^T4ia* *l* 

■tx;l/M l l fi, 3 ^SKx— * i: LT, 3 WzMM 

© Miw BttoBflf < * - > *) # 5 ft s. 

RflUC bt«' tf^E7*>l/M12. M22, M23&, ^ft^ft 20 
3 3?7cBffi7*-*.S 1, S2, S 2lcg-5< 3&7C«i6 
**U B0g2, g2, g3©B^#-ytfll5!)tt 
^t£ftSC:i:fc:ftSo 
[0 0 2 8] *|C, Xr-y/S 6 "ettS^fttx/i/CS 

£*fw»j£sft*. cc-ea, *^5©s*/^^- 

m 6 K^£ftS*M&SllBB, fe&PS 
tr^tfKfcSftSo 

[0 0 2 9] $1\ *Hfit0®T«, 04KSl/ft*^ 
5©Bj£ttB p 1 i: p 2 , Rtf p 2 t p 3 *B.£ltGK± 
"**;(?©ttjftOT£ftU *^7©7tfA*|pJ«2O0^ 30 

ft* d Q « # v © 3 ^7clH<gff 5>J R * 6 # 5 ft 5 HIS 

s 0 ftfc\ c©?!^©**^©^!!^*-*©*^: 

Wi 3 >^S®x-2 £ £ KRS-r So 

[003 0] t n/d T = Q/'d Q (S2) 

S5f*©B#*7*;l/ (MIL M12, M22, M23) 40 
ZtK, B6£&l*&$j&&gWSB (rlK r 12, r 2 
2, r 23) *«^T«o C-<DSjSe»«Htt*aJ»*T 
•/l/^£T?*«Bj&ffiB©BB*B*«>©T?a&»>H *H 

«BBJBT?tt 1 3»t7E*lflilc»ft*fi5 ©T\ S£®B©iPj 

!St"5RJitr^/ (eiJAff MllirM12l4«t 3^7t^ffi 
x-*S i*#JBf«) tcMLTfi, *OSjSra©*W 
ttirrtW^E^WWB Mffe S J: ? (c&£9IU6BftR 

[003 1] «33K7G*ffi-r-* (SI. S 2) & ? 50 
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n'-rn 2 ooiMioB«-wai*n*a4 tfc 3 
aax-*c:fcfc:3»PiaE««<a'ftSo ?*t>%. *nm 

BBXHZ, Mll£M12, *5jcOPM22i:M23©fflj!)^n ; f 

S„ B6fc***3K£m^rVPiTi:fca:BS 
tf;K feBfef^KJfef'*. ftfc\ 06*, NO 
NE«P&^x;W¥abftv>cfc£^-f 0 «±©HS 

fc «fc t» , KKftf/Wi 0 7 svr«j£(ttB t $umm 

BBtSS^SftSCfcfcftS. B*8HRfctf?£Bt©** 
[003 2] «±© J: 3 £ LTttWExVl/©S£*fr 

ORSfeJ:tf*©B^*fT5o cc?»BB%B^f« 
•>-fVH!>*4rtU xVX?W 1 0 6©Bffitc«^ 
f S o *>-f y K"> (iB^S^gP i: t9(Mfmft> 5 ft 

5 , *Hfil^T'{iS]m^ftlT'gi5^ ; ex;l/M22^0 7 K 

m? p 2 ©BjSiffifiTmfeBB (t^T, B#g 2 tra 

w *assBk«fc»>4is-r«. ft*. a^aB«3D 

3 > e - ^ ^7 7 4 y t> 7. K tS It S if ^©-? T* h 
t>, BfilO#jS-ea&*. B^^WDftHftBBKtet) 

«B-6nfcBB/<^->*»6 mmtsmic <t oh«*4is 

't'Stti:, Addison-Wesleytttil)IS"Computer Graphics^ 
rinciples and practice, 2nd edition in C"FoleyS># 
©pp. 741~744lC|B^tlTV-5 Texture Mapping£ffll^ 

B^s^sPT'^sxwx^U'-i' i o 7 tutors. <:© 

x;l/©S^®^-T0T'feSo 08Ki3V^TV(iB# 

^±©#^^6 ni^3^7C^x;l/©S^^ 
7 $ ft S 46©i^7 # * > T'fe S o 
[0 0 3 3] ^{C, 7.f->y^S 8t^^r3.-+ftc<fc5 

'ofeB^tt^ Xtv7S 9i:0*^a^7-rSo * 
fc, ro#5ftrca-Hf^^S¥f*^a5C LSfcttC 
R*^U»>»^Lfei:WJ6«ftfe«^tt, Xfy^S 1 0 

[0 0 3 4] Xr'y/S 1 1 T?li, CLSftliCRO^ 
'J-y^lcJ;§^^v^©^il«:fTt/\ ^©^*tt 
T, *p«7SjS««if©BjS»BttBt#fif 
•TSo fftt>^, S-f, 5ifiEOS4*ft-t?***^5IS 

|Bj£g{fc£-£So fLt> CCtaL'S^flfefWB-r* 

^ 5S^ftB*« E<ou^mmmich s *«e^- s . 

[0 0 3 5] Xf'V7*S 1 2-e«, fT/cftS4*mc=fc 



(6) 



S 1 S'V *5"CttlftlXf-'V7S 1 3^.mtS 0 

[0036] mcKn^mm&vm&fcWffimvft 



[0 0 3 7] MX.I& a— «fjWfe*lftca¥f*Oia«* 



5«jSttH#p i OUHHMHtf rii) Si;: 

a^ftcfesriRi^oiHWEjWi^snfc (cr^ u y * 
snfe) w^tt, tafm^rjiw tnonej t*&5© 20 

[0 0 3 8] Xf'^S 1 5T'S, Xfy/S 1 lt'f 



^KlIEHOffix- ? (P*tfM 2 2 3&» 5 M 1 2 © «t 5 ft 30 
HBSt'rVMclW D Wfc SH»& M 1 2 © 3 #7cSffix 
-*S 1 tSttm-pOWttHMBtr 1 2©fe4gx 

[0 0 3 9] Xf-y/S 1 6T*ti, iSt^tS^ef. 

vicfflmu a^a^sp (f-fx/w 1 o 7) 

3Vf«o *LT, Xf-y fS 8©a— «fSf^©K#tM 

[0 040] tujBjijbfcj: 5 m 1 <onffi&m\c& 40 
n«\ p t) /c 2 b©a^4*H«*» z>tmof.<D 3 ^ 

gffix- >*4«U C ©£$ L/c 3 Kaffir- 
K 2 o ©M^ftBii© V vf tifr <£ t) f# & ft 5 jBtts < * - 

y*asow*Taj^7 , /i/*4«-r*. ^br, c©£ 

oTfe, JI»bfc*^«iS«©tt'lffl©ajS«tilRtf»iqi 

50 
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[00 4 1] $fc, B*r-*©^Jt«flM>a:^© 

t\ &g&H$b^u©^«fc'>&<T-rt?„ hic, 

tt3B^*-^ i E>g;LT^£©T\ 'AttA©tt^^© 

&¥#© 3 3>?7ca»y»6n*. 

[0 0 4 2] (£2©|gflttgl8) ±$bfc!g 1 ©Hfi8J£ 
IHcfcl^Ttt, RO^ofciSftllB^S&abfeitt^f*:© 

^bfc^^ic B4Wf©a*ttBK*si;T^«7 , -if g 

tttcftbT, S 2 ©HSMHBTttx 1 o© 3 3fc7cSiB7 f 

ftS t) ttttTfiSBf 5 £ 5 let Zo 
[ 0 0 4 3 ] H 2 <D$m&mK. <fc SB^MSSB 

%>o vxr. m2(omimm(DW}tt*®2<Dyti-**- 

[0 0 4 4] H2fcjjvbfciQji©3^ «££{*© 3 3?7G 

aif-^^tsxfyT's i~s 4$r*©saaa 
±MLtcm 1 (Dmmmtmmx'&Zo u^x, urx- 

It, TsT-V/S 5W®©3^B&S^!®KOV>Tii 

[0 0 4 5] Xry:/S 5T*«&©3#7ESffix-*fr 
&tt¥fl*r/l/*£j«-rSo S& 2 ©*SfB&8g-e««¥{* 
*7VU4 2 0©gp#^-rVl/M K M2«kD^:5o ^tx^ 

n©aWKr;I/©Wtt%H9»c*-ro C£T\ fi»J^tfg|5 
^r;l/M 1 « 3^7C*ffir-^ S l ©]Iii'r-*£g 

cy< 3 ysmmzft-Do zlx, 3^7cSffir f -^©H 
n»©Hft««©a«/^->i:, ^n^ncas^iS 

■TSa«g 2(f©=ftiB«©B«U<*-^-4:38«'S^"*n 
Twowtsns. n«'t.bT, gP^x^M 2 » 3 ^ 

7caffiT-^ S 2 tcB^g 2, g 3©Mfif<£— ytfK 
[0 0 4 6] Xy-y^S 61C$5^X, Sfft^f 

/l/©B4*fr^as»E«n*. CCT'li, Sl©HB8^fll 

i: n«ic b r * * y <»im*7* - * <Dmm*mfet 

M 2 ©t-n^nt WbT«jS»»«H r u r 2 

^ns. *4b\ ^^l6IBH©M4S©^ttBtta i o 
t^-TJ:9{i:2o©B^©a^©^fiB (pi, p 

[0 0 4 7] Xr7^S7T'S4»ffiCi« 

fe«fci?^©a^%fT-5c ntmmvm 

\Zt$^X, SP^^^l/M 2 ^-0 1 0 fclTjVf p 2 ©H^fi 
BT^fcB^ (S^oT, B^g 2tHb) ^SffiSKtC 



11 

10 7) iCg^f 5 0 
[0 0 4 8] Xf7/S 8{C*3l^TrL— yicj;^ 

t>fc»&tt, xfy/s 9«fc»>*«yift»7 , r*o '* 

fc> iRffS nfea-1fiMWW***ft* C L * felt C 

[0 0 4 9] Xf-y^S 1 l?a, C LSfctiC R©? 

U^tc£S#^7&£©»&fTV\ ^«0^*i:L 

[0 0 5 0] xf-y/s i tffcfciiffcfcfl-fc.fc 

oT^£n£fe£ftgtf^ftg^©^tf^©^ 

S i S'V ^^T^ttnT.r-y^'S l S'sjityo 

[0051] «ffca«**ft3WHflE©sise»ieHo^ 
y^si 4 'sit*. : z(Dm&?z&ft : e7 : >i'\<D®*)m 

[0 0 5 2] a— !ftf£AfrlCtt?tt<i!)l3K& 
•¥(*©lsl«*«^Ufc«#te'li£IJfflf*f f ;I/*W^ *■ 
v&jSGHItf p 1 1?* t> > MKM¥ft©ft£lRl'\©ia$K 

ft^snfc (cR^'j'y^snrc) 

r;bM 1 (DfeKStf;^ TNONEJ T*££©T\ BS 
[0 0 5 3] Xf-y^S 1 5T*(i. Xf7^S 1 IT** 

161 a * & i: a *i -cv s s^snwGHoiS?*- * 

SP^tx/l/M l tc«0#*>*«^«» gP^^-r/l/M l © 
3#7tSffix-2 S 1 ££-f£flHt'?(0£j£&Iil6ig r 
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i©£«x-*) KjgffSfts. 

[0 0 5 4]Xx7 7*Sl 6T'tt, S^-T^tSP^X 

'JKWSBU Mtt&Fffi (t^X7"W 10 7) 
^■fSo ^LT, Xf-y^S 8©a— »fg&tt©8tf§fc:8i 

[0.0 5 5] COtt, A^^O^fifitCJC&CT, 2 
10 So flfa*tf» 01 0 ©&j&£illEB r l£*5VTtt, m 

ffim$m<r>w$?zib% p i ©ftg-eas&g i tmm 
gzow-sttrntti : o, Mjmwmmv&Qx&z p 

2©ftgT-(M#g l i:H^ g 2 ©}l£-tt:3s# 0 : K 
sfsfHSig l £ g 2©H&^£-V£gP# : &T'/l/M l K 

[0 0 5 6] &L±.<D£oK. »2©HSBBJB"C« 1 O© 

3 &7t^® r- * t n. t & % 2 mwwfam&fr e> ©a 

»¥#©*ffi©iii^^-^*U 9 g*RK«{kr* 

[0 0 5 7] fcfc, W±©HS6Jg®T«, $¥{*©!!§! 
. Lfct)\ Xf-y/S 1~S 4$T£J8¥ffc©3#7C7*- 

xf7/s5~si 6 $-?£$?&© 3 # 
Ttm^mmtLT. 2o©Mg^#-e«i£LTt>j;vv 

WMW<D 3 *tct-* t LT, «^©S¥#:H^©I?1 0 
30 fcBttHfr 6 4^ t 3 Wx^mf- ZtZVtZ 

. ^-LT, Xt-yys 5«|^©«^©3^x-^ 

^sjesaiE*v^T7 7V/wcfeti£nfcM¥ft© 3 ^ 

[0 0 5 8] Sfc. ±IB#HSI^fi§T*a. W?fla0 3* 

40 S2^ffl®, '«iBWftiHS^'waHbT, cnswa© 

.t^tc-rntf, -S, 3^7tf f -^*7r-f';P{c|S^t 
Tfc 5 £-3 «¥^©3^7tx-^ 

</^B'li^lT*3^7t; ; &'r>'l/^IS^T*tSo ^x-y 
7S 5«lC*ttaap?#«D335?7Ct7*/l/4iSl^fc,. il© 

«sn* 3?5?7C«iii7*-*ti:B«jabTfi»tf < JWK 

a, ±aufc*^»ttfcra«©fflaiT?*^o'3?*t7c 

50 a«o**^ff5c2:««^**. 
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[0 0 5 9] gfc, &L±<D$mfc1&lClS^Xl&ti&ftZ 

K^^^m^yf^Vm.K9ciL^X, 3.— tffcio 

[oo6o] tit. <i<Dt%. 3L—*ftfm%.Ltcffimm 

[0 0 6 1] $fc, ±ffiUfe«l«}glUc43V>Ttt, tt 
3 oo&fi-eaHB LfeW^OfflSitco^TKW b 

3oa±Offi«OSjS»€)B«KBBLTSSti:.* 
[0 0 6 2] $fc % JULh©HaS»»k:i3t>Ttt«¥»* 

tot "»T fe ;±8BH«50filK: J: o TaSS tifc 3 Wm@m. 

[0 0 6 3] $fc, W±©£jl9BttE:&l^Ttt«^{*© 

335C7ciB«*a^ ! r*l6li:A^50ffijiSie«i% 1 3*7C« 
fl*tt*© 3 ^©^{4fi, 2rftfr&JlteMt*jlta; 
[0 0 6 4] &4b\ *«Wtt, «ft<D«ffi (H*tf*X 

*»6«**n*i/^Alca»LTt, -o© 
[0 0 6 5] *fe, *«W<0i«tt. Wifii/fe*SS*« 
©->7.-fA&£WJgg©3yfc:;i-:$? (f'fcttC PU 

^MPU) ftTCWIEttlcttMS fttc ~fnV=7 A3- F* 

[0 0 6 6] c©#&, E«*KW»6WB*nfeyo^ 
^©TWvAn- FfcfBltLfeiHIiJKtttt 
[0 0 6 7] rn^9A3-F*«l&r«fc»OlB«j8 
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ytT^xt. ytmwrjT.t, cd-rom, cd 

— R, ^»Ktt©^*U*-H, ROM* 

[0 0 6 8] gfc, 3>tTa-^3WRtHbfc7*a^A 

[0 0 6 9] SSlc, fBtt«#fr£§!ai£ft/c7a?7 
An- KflV. 3>lfa-*lCJtA*tlfc«aHI*- F 

*tytffi&$ft;fcSL ; £©7 , ny^A3.-F©fi;r;tc 
»t3#. *©«&&®#- F^«tl&^3^y Mc#fc 
5 C P U£2#3SI6©^©^$;fc«:£»*firV.\ f 

©Mpc cfcoTtuiSb ^dHWowmsnei 

20 [0 0 7 0] 

[IBB©***] «±WBLfeJ:3-K, *58WK«J:*in 

«t"r;I/T»ft < i: fcHflffi*©^*^!^© 3 -%tgH 

[0 0 7 1] 

[0ffi©fS¥&M 

[0i] *n«s^flifc*5H«fiiagg©«ni&«}Bg*^ 

-t7n>y£0T*&5o 
30 [0 2 ] $ 1 ©£ffl0£flgfc £ 5 3 &rcPH*$a*¥Jfi£ltt 
$f S7n-^*-FT&3„ 

[0 3 ] imimm<DMBft&<D 1 M*m-r0-??s5 o 

[0 4] H3©Jl»*JSfeK*S*p<7SjlS©S{fc%ttW 
f50T*&5 o 

[0 5] H^8l«©iiatCj;»3, «&g 1 tg2<Dttfo 

[0 6 ] m i ©utt^ffi^fevT&ssnsffihEf*;!/ 
40 [07] siiioiawBUfcfcttsssfw-x;^ 
[0 8 ] xmm&micmfz 3 wt*?)\/<DW&$M% 

[0 9] SB2©ll«fc»fcfci/>T^T£nsW$K7*;U 
©Wtt*^fH^*«. 

[010] mznMBMicmz&'wwtTJitDmim 
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Wffl 2000-672 




[01] 



106 



101 

J 


102 


103 

« 


CPU 




ROM 




RAM 



107 



109 
J_ 



[04] 
1 




l/F 



— 108 



Pi 



/ r v 
/ i \ 

/. \ 
/ i \ 



-A.-. 

Pa 



3r' 



Pi 



[02] 



[03] 



SI 



S2 



1 


JS3 









i I s4 , 



Li 



ss 



1 



i 



S6 



1 



S7 




Li 





— — 



~S15 



J—S16 



[05] 



(XY.Z) 





i 



[07] 



■ 

\ 



/ 
/ 

4 Til 



I H2 ( R3 



\ 
\ 

« 

\ 

r23 _\ 



Miu.v-y y 7 — 



[08] 



[01 0] 
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[06] 















Mu 


Si 




nr 


NONE 


M12 


Ml2. 


Si 


S2 


ri2 


M11 


M22 


M22 


& 


& 


r» 


M12 




M23 


S2 


S3 


rz3 


M22 


NONE 



[09] 

















Mi 


Si 


81 


82 




NONE 


Mi 


Ma 


Sa 


S3 


88 


F2 


Mi 


NONE 



F#-A(##) 5B050 BA09 CA04 CA07 DA07 EA04 

EA07 EA12 EA27 FA02 FA09 

5C061 AA29 AB03 AB08 AB11 AB12 

AB17 AB21 



